On the Kolmogorov complexity of functions of finite smoothness
نویسنده
چکیده
The complexity of a computational problem can be rigorously defined only in a model of computation including the description of the input information and the set of permissible primitive operations of which the solution algorithm must be constructed. The complexity of an algorithm is then defined as the number of primitive operations (they may be counted with weights) used in its program. If the input is available approximately or is incomplete the answer can be found only within certain error bounds. One may now consider all permissible algorithms (if there are any) to evaluate the solution within these bounds. The minimal complexity of such an algorithm is called the complexity of the problem. Rigorous definitions and detailed discussion of this concept can be found in Traub and Woiniakowski (1980). This paper deals with the Kolmogorov complexity of evaluation of a continuous function. The concept of the Kolmogorov complexity (which in the rest of this paper is referred to as simply “the complexity”) fits naturally into the general framework outlined above. For a continuous function y = f(x) one may consider both x and y represented approximately, with prescribed finite numbers of binary digits; the algorithm of evaluation can be described as a sequence of operations on binary digits with primitive operations being the elementary binary functions. Rigorous definitions are given below. Let B, be the set of n-dimensional binary vectors, i.e., all vectors of the form5= (6, 52,. . . , &), 6 = 0, 1. The functions B, + B,, for various
منابع مشابه
Kolmogorov Structure Functions for Automatic Complexity in Computational Statistics
For a finite word w of length n and a class of finite automata A, we study the Kolmogorov structure function hw for automatic complexity restricted to A. We propose an approach to computational statistics based on the minimum p-value of hw(m) over 0 ≤ m ≤ n. When A is the class of all finite automata we give some upper bounds for hw. When A consists of automata that detect several success runs ...
متن کاملThe complexity of conservative finite-valued CSPs
We study the complexity of valued constraint satisfaction problems (VCSP). A problem from VCSP is characterised by a constraint language, a fixed set of cost functions over a finite domain. An instance of the problem is specified by a sum of cost functions from the language and the goal is to minimise the sum. We consider the case of so-called conservative languages; that is, languages containi...
متن کاملInformation Theory and Quadrature Rules
Quadrature rules estimate ∫ 1 0 f(x) dx when f is defined by a table of n+1 values. Every binary string of length n defines a quadrature rule by choosing which endpoint of each interval represents the interval. The standard rules, such as Simpson’s Rule, correspond to strings of low Kolmogorov complexity, making it possible to define new quadrature rules with no smoothness assumptions, as well ...
متن کاملThe Kolmogorov complexity of infinite words
We present a brief survey of results on relations between the Kolmogorov complexity of infinite strings and several measures of information content (dimensions) known from dimension theory, information theory or fractal geometry. Special emphasis is laid on bounds on the complexity of strings in constructively given subsets of the Cantor space. Finally, we compare the Kolmogorov complexity to t...
متن کامل3D Scene and Object Classification Based on Information Complexity of Depth Data
In this paper the problem of 3D scene and object classification from depth data is addressed. In contrast to high-dimensional feature-based representation, the depth data is described in a low dimensional space. In order to remedy the curse of dimensionality problem, the depth data is described by a sparse model over a learned dictionary. Exploiting the algorithmic information theory, a new def...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- J. Complexity
دوره 2 شماره
صفحات -
تاریخ انتشار 1986